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© A system and method for improving the quality 
of decoded images, without any cost to compression 
efficiency, in both progressive stil! frame and motion 
video applications wherein the images are coded 
with intraframe transform based coding techniques, 
such as Discrete Cosine Transform (DCT) coding. 
Prediction of the AC components is utilized and 
operations are performed on the AC coefficient pre- 
diction in the decoder portions of the system in 
combination with a thresholding technique, input im- 
ages are subdivided into blocks of pixels, which are 
changed into blocks of coefficients by forward trans- 
form coding resulting in DC coefficients, representa- 
tive of the average value in a block of pixels, and AC 
coefficients, representative of harmonic frequencies 
in a block of pixels. AC coefficient prediction is 
performed using both DC and AC coefficients from 
the block, whereupon the predicted coefficient val- 
ues are thresholded and the thresholded coefficient 
values are added to their corresponding transform 
coefficient values for the given block. These steps 
are repeated for all of the blocks of the image and 
the image representation is recovered by applying 
an inverse transform operation to the results of all of 
the additions for all of the blocks of the image. 
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TRANSFORM CODING US.NG COEFF.CIENT PREOPTION TECHNIQUES 



aa 6 2nHr ,' nVenti0n relates t0 electr0 ™ im- 
age handling and more particularly to a system and 

method for operating on image data that has been 
transrorm coded, e.g., motion video data, using 
coefficient prediction techniques, to optimally re- 
cover the coded image while facilitating efficient 
compression of the video data. 

Efficient motion video compression systems 
Really use a combination of intraframe anJ inter- 
f ame coding techniques. In intraframe coding a 
video frame (or field) of a sequence is coded 
w-thotf reference to any other frame (or fieW) in 
he v,deo sequence. In interframe coding a video 
frame ,s coded by referencing one adjacent, pre- 
v-ously coded frame. Since the typical informal 
content of consecutive video frames changes very 
-Me compression of frame differences, and thus 
n terframe coding, is typically more efficient than 
intraframe coding. Efficiency can be further im- 
proved by applying well-known frame to frame mo- 
ion compensation techniques to the basic inter- 

Jn^f'^ 35 d6SCribed for in ^nce by H 
MUSSMANN. P. PIRSCH, and H. GRALLERT in 

iJ«rT SS u Pi ° tUre C ° din9 "' Proc - IE£ E. 73. 523 
1985. It is thus desirable to use interframe coding 
as much as possible to optimize compression rate 
m v,deo sequences, but, nevertheless, intraframe 
coding cannot be avoided. 

Intraframe coding is particularly necessary to 
handle scene changes and also to meet certain 
proposed requirements arising from recent stan- 
da ds efforts for motion video compression. Re- 
garding these standards requirements, it appears 
that ,f certain proposals are adopted, it will be 
necessary to be able to access any video frame in 
a sequence within certain time limits, and to be 
able to playback a prerecorded video sequence in 
ast forward and fast reverse by accessing and 
sk.pp,ng frames with a certain periodicity. Such 
requirements call for at least the periodic use of 
intraframe coding. For example, a fast forward 
mode at 10 times the normal speed would require 
accessing, decompressing, and displaying a video 
frame every 10 frames in the sequence. Since 
interframe coded frames need to refer to adjacent 
previously decoded frames, they cannot be used to 
implement this function. Only intraframe coded 
frames can be decoded independently of others 
and thus a fast forward function at 10 times the 
normal speed requires an intraframe coded frame 
or every 10 frames. It follows that the length of 
time required to randomly access any frame in the 
video sequence will be constrained by the maxi- 
mum number of frames between intraframe breaks. 
Unfortunately, the frequent recurrence of intraframe 



th? T? S thS qUa ' ity 0f the ima S e s e°^nce 
hat would be otherwise achievable. Intraframe 
transform coded frames, in particular, can show 
very annoying blocking artifacts at low bit rates 
s These artifacts are particularly noticeable in smooth 
areas of the image and they appear as a periodic 
flashy of blocks which the interframe coding then 
gradually tends to correct. 

10 coding 9 t0 * e common| y-aPPlied transform 
« coding technique, it can be adapted for use with 
either the intraframe or interframe mode. In trans- 

Coln 0 ?nr 9 ;f artiClJ,ar,y DiSCrete Cosine Transf °™ 
Coding (OCT), an image is typically subdivided into 

blocks of, e.g., 8x8 pixels, each of which is then 

- ^formed through mathematical operatl J^a 

new representation of the original block of pixels. 

The p,xels» ,n the transformed blocks are called 

transform components or coefficients. Known ex- 

20 Si 65 °I tranSf ° rm ° Perati0ns are the °CT, Haar. 
20 Hadamard. and lapped overlap transforms. In all 
cases, the transform operation has the property of 
com pacting the energy of the original pixel blocks 
nto a few transform components, such that only 
those coefficients need to be quantized, com- 
as pressed, and transmitted. When the transform com- 
ponents are quantized coarsely, which is the case 
C °T 6Ssion rates of motion video 

SSI » « 8 b, ° Ck StmCtUre intraduce * 
blocking" artifacts. 

30 ,. D 1 t6chn, 'q ue 's described by B. NISS in 
Prediction of AC coefficients from the DC values" 
ISO/TC97/SC2AVG8 N745, May 1988 T and 
Prediction of AC coefficients from the DC values 
revisited", JPEG 147, ISO/TC97/SC2/WG8 

Z£ I"?. 1988 ' f ° r impr ° Vin9 the *«% °< a still 
ST nrr J S . C ° ded USing 3 Passive transmis- 

til irll n e ?' qU6 ' TW ° VSrSi0ns 0f P r °9 ressi ^ 
still frame DCT encoders according to NISS's pro- 

posal are shown in Figs, la and 1b, along with a 

40 mc%n I 9 " f- which Ff9ures are *£2Z. 

" £ NISS ' W - PENNE *AKER, H. 
POULSEN, J. VAABEN, "Report on Front-End 
meeting". JPEG 245, ISO/IEC JTC1/SC2/WG8 doc- 

« an input representing a block of pixels from an 
ongmal or other image to be coded is firstly trans- 
formed by DCT in a transformer 10. The DCT 
transform of the block of pixels produces a so- 
so AC .n ° C : C ° efficient s, "9 nal °C and a number of 
so AC-coefftcent signals AC. The DC coefficient is 
representative of the average value in the orig na 
block of P ,xels, while the AC-coefficients represent 
various harmonic frequencies therein, .nitial.y orty 
the DC components are quantized Q i n a quantizer 
20 and transmitted over line 15. Also, using the 



quantized DC values only, some of the AC-coeffi- 
cients can be estimated or predicted in an AC 
predictor 30. In the prior art technique of NISS the 
DC values of a set of 3x3 blocks are used in 
predicting AC-coefficients for the center block of 
the 3x3 array of blocks. With those predicted AC- 
values, the technique was able to improve the 
appearance of the image compared to that gen- 
erated by the DC-components alone, in NISS f s 
progressive transmission system the difference be- 
tween the quantized original AC components on 
line 16 and their corresponding predictions, which 
are quantized Q in a quantizer 21, is computed in a 
summer 40 and transmitted to obtain a coded 
version of the original image, as shown in Figure 
1a. Alternatively, as seen in Figure 1b, the dif- 
ference between the unquantized original AC com- 
ponents on line 16a and their corresponding pre- 
dictions from the DC components may first be 
computed in summer 40 and then quantized Q in a 
quantizer 22 before being transmitted to obtain the 
coded image. 

A typical decoder for use with the encoder of 
Fig. 1a is shown in Fig. 2. The coded and com- 
pressed signal received from the encoding trans- 
mitter is firstly decompressed and then processed 
as follows. The DC component is sent over line 17 
to be dequantized Q -1 by dequantizer 25 and 
inverse transformed IDCT by inverse tranformer 11, 
and also over line 18 to AC Predictor 31. The 
output of AC Predictor 31 is quantized Q by quan- 
tizer 23 and summed in a summer 41 with the 
corresponding AC coefficients from the received 
signal on tine 19. The output of summer 41 is 
dequantized Q" 1 by dequantizer 25 and inverse 
transformed IDCT by inverse tranformer 11, and 
included in the decoded output with the decoded 
DC component. 

It is important to note that in NISS's system 
AC-prediction is performed over the whole image 
regardless of whether the image contains smooth 
or active/complex areas, it also has no limitation on 
the value of the AC-predictions. Any errors in the 
predictions are left to be corrected later when 
transmission of the AC-differences is completed. 
Because of these features, NISS T s system may 
introduce large prediction errors in active/complex 
areas of an image. These errors, in turn, can de- 
grade compression efficiency, .sk Accordingly, it is 
desirable, and an object of the present invention, to 
provide a system and method for correcting the 
artifacts in the intraframe coded frames while 
achieving substantially improved image quality that 
would not otherwise be possible at low-bit com- 
pression rates. Additionally, and most significantly, 
it is desirable that this improvement be achieved 
with no penalty in compression efficiency. The 
invention solves the problem of correcting 



"blocking" artifacts that result with intraframe cod- 
ing, while maintaining image quality and compres- 
sion efficiency, by appropriately utilizing transform 
coding techniques. 

5 Following from the above-described prior art, 

the present invention is directed to improving the 
results of intraframe coding of electronic images, in 
the form of motion video sequences or progressive 
still frames, and particularly, to a system and meth- 

10 od for improving image quality in intraframe trans- 
form based coding techniques by using prediction 
of the AC components. The invention involves op- 
erating on the AC coefficient prediction, which op- 
eration takes place only on the decoder portions of 

rs the system in combination with a thresholding tech- 
nique. 

The systems to which the invention is directed 
essentially operate by subdividing input images 
into blocks of pixels. These blocks of pixels are 

20 changed into blocks of coefficients by a forward 
transform coding operation, and the transform co- 
efficients include: DC coefficients, representative of 
the average value in a block of pixels; and AC 
coefficients, representative of harmonic frequencies 

25 in a block of pixels. The invention recovers a 
representation of an input image from the transform 
coefficients by taking the transform coefficients for 
all of the blocks of the image and beginning by 
generating predicted values for selected transform 

30 coefficients in a given block from the values of its 
transform coefficients. The selected coefficients 
comprise AC coefficients from the block. After gen- 
eration the predicted coefficient values of said 
block are thresholded and the thresholded coeffi- 

35 cient values are added to their corresponding 
transform coefficient values for the given block. 
These steps are repeated for alt of the blocks of 
the image and the image representation is recov- 
ered by applying an inverse transform operation to 

40 the results of all of the additions for all of the 
blocks of the image. 

Typically, the transform coefficients for the 
blocks will be quantized so that the predicted co- 
efficient values are quantized before thresholding, 

45 and the results of the additions are dequantized 
before applying the inverse transform operation. In 
such event, the quantizing of the predicted coeffi- 
cient values before thresholding is a finer quantiza- 
tion than that of the transform coefficients of the 

50 blocks. Also, scaling of the transform coefficient 
values of said blocks may be carried out to match 
the precision of the thresholded coefficient values 
before the addition step, whereupon compensation 
for the scaling is performed after applying the 

55 inverse transform operation. 

Decoder embodiments for both progressive still 
frame and motion video applications are disclosed. 
Fig. 1a is a block diagram illustrating a progres- 
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Fig. lb is a block diagram as in Fig. 1a illustrat- 
ing an alternative progressive still frame DCT 
encoder in accordance with the prior art. 
F'9- 2 is a block diagram illustrating a DCT 
decoder for use in combination with the OCT 
encoder shown in Rg. i a . 
Fig. 3 is a block diagram illustrating a typical 
DCT motion video encoder in accordance with 
the pnor art. 

Fig. 4 is a block diagram illustrating a typical 
DCT motion video decoder in accordance with 
the pnor art. 

Fig. 5a is a block diagram illustrating a DCT 
moton video decoder in accordance with the 
present invention. 

Fig. 5b is a block diagram illustrating an alter- 
nate embodiment of a DCT decoder in accor- 
dance with the present invention, .sk Fig 5c is a 
block diagram illustrating yet another alternative 
embodiment of a DCT decoder in accordance 

with the present invention. 

Fig- 6a is a block diagram illustrating a DCT 

progressive still frame encoder in accordance 

with the present invention. 

Fig. 6b is a block diagram illustrating a DCT 

progressive still frame decoder in accordance 

with the present invention. 

Fig. 7 is a diagrammatic representation in il- 

lustration of scaling factors used in connection 

with the invention. 

Fig. 8 is a flowchart illustrating the computation 
of AC predicted values using a thresholds ac- 
cording to the invention. 

Fig. 9 is a flowchart illustrating the computation 
of two threshold values of the thresholder of Fig 
8 used in AC prediction. 
The present invention involves a system and 
method for improving the intraframe coding of elec- 
tronic images including various embodiments re- 
spectively capable of treating data representing 
either motion video sequences or still frames 

Firstly, with regard to the motion video im- 
plementation, reference is made to Rgs. 3 and 4 
wh,ch show simplified diagrams of a typical prior 
art motion video encoder and decoder, respec- 
ively, using, e.g., the DCT, although other trans- 
forms could be used without loss of generality The 
upper path of the encoder of Fig. 3, including 
transformer 10 and quantizer 20, is the encoder 
proper and will be referred to as the "transmission 
encoder". 

For intraframe coding, switch Si in Fig 3 is i n 
position 1 so that the input image data to the 
transm.ssion encoder is directly operated upon by 
the DCT transformer 10, quantized in quantizer 20 
and then transmitted. It is noted that the quantized 



outputs will be typically entropy coded in a coder 
50 using Huffman or arithmetic coding techniques, 
before transmission. However, such additional op- 
erations or appropriate extensions, will be chosen 
s by, and within the purview of, those of skill in the 
art and need not be discussed further here. In the 
decoder in Rg. 4, switch S2 is also in position 1 
allowing the encoded signal to be dequantized (Q- 

,„ , nr n -n deqUantiZer 25 ' and inverse| y transformed 
w (IDCT) ,n inverse transformer 11, before being di- 
rectly output as the reconstructed image, as well as 
being stored in a Reconstruction frame buffer 60 
The output of buffer 60 may be summed with the 
output of inverse transformer 1 1 in a summer 43 

The encoder of Fig. 3 also contains a decoder 
70 such as that of Fig. 4, in its feedback loop so 
that the reconstructed image can be used as a 
pred.ction for the next frame by subtracting in a 
summer 42. Again there may be appropriate exten- 
20 s.ons to the basic coder/decoder (codec) of Flos 3 
and 4, such as the introduction of motion com- 
pensat.on and filtering of the predicted frame. For 
interframe coding, switch 81 is in position 2 so that 
frame difference signals from summer 42, rather 
25 han original frame signals on line 14, are trans- 
formed and quantized by the DCT transformer 10 
and the Q quantizer 20, respectively. Similarly 
switch 2 of the decoder is in position 2 so thai 
frame reconstruction is obtained by adding the 
so reconstructed frame differences from summer 43 to 
the prediction (previous) frame. 

tha ^T r ^ i0US ' y n0ted> at hi9h c °™Pression rates, 
£ * * AC-components are quantized so coarsely 
that they are simply not detected in smooth areas 
35 of an image, thus introducing "blockiness". These 
artifacts are typical of block-oriented transform 
techniques and they cannot be easily corrected 
other than by the use of finer quantizers which 
increase the transmission bit rate or bandwidth 
to requirements. 

Prediction of AC-coefficients is one alternative 
to be used to correct block artifacts. The scheme 
shown in Figure la cannot be used, however be- 
cause it assumes that the AC predictions are quan- 

f* d ° With the same wantiwr 20 as the original 
AC coefficients. Since this same quantizer was too 
coarse to avoid the artifacts in the first place it 
does not help with the prediction either. It is possi- 
ole to move the AC quantizer (21 in Fig. i a ) in the 
50 system to the position of quantizer 22 shown in 
Figure 1b; but, in such case, large prediction errors 
may occur in active/complex areas of the image 
thus degrading compression efficiency. In either 
case the complexity of a motion video encoder 
55 incorporating the arrangements in Fig. 1 a or Fig 1 b 
m place of the "transmission encoder" of Rg 3 
would be increased significantly, as the prediction 
circuitry would have to be replicated in the feed- 



back (decoder) path. 

Consequently, for intraframe coding in accor- 
dance with the present invention, the encoder may 
be essentially of the form of the "transmission 
encoder" shown in Fig. 3. However, the feedback 
decoder 70 will be of a form such as shown in 
either Fig. 5a, Fig. 5b, or Fig. 5c. It will be seen, 
therefore, that any increase in complexity in the 
system is limited to the decoder and accordingly in 
the encoder to the decoder path. Further, as will be 
seen below, there wili be no degradation in com- 
pression efficiency. 

Turning to the decoder embodiments shown in 
Figs. 5a, 5b, and 5c, 'all will be noted to incorporate 
the combination of 1) performing an AC prediction 
on both the DC and AC coefficient inputs, along 
with 2) a thresholding operation P. More particu- 
larly, in the preferred embodiment of Fig. 5a, the 
DC and AC -coefficient inputs, before scale up at 
75, are fed oyer line 91 to AC predictor 32. This 
predictor may be readily implemented by a com- 
bination of simple arithmetic operations, such as 
that disclosed in the MITCHELL ET AL paper cited 
above and the use of lookup tables. The prediction 
coefficients output by predictor 32 are quantized q 
in a fine quantizer 24, that is, one that produces a 
quantization q which is finer than the quantization 
Q of quantizer 20 in Fig. 3. The finely quantized 
coefficients from fine quantizer 24 are then 
thresholded P in a suitable thresholder 80. 
Thresholder 80 may be implemented by a lookup 
table or a comparator, as appropriate for the op- 
erating parameters. The thresholded AC coeffi- 
cients output by thresholder 80 are summed with 
their corresponding scaled up AC coefficient inputs 
on line 89 in a summer 44. When switch S3 is in 
position 1 , the output of summer 44 will be sent to 
the remainder of the decoder which essentially 
constitutes the components of the decoder of Fig. 
4 with the addition of a scale down function at 76, 
to compensate for the earlier scale up. The scale 
up function on the AC coefficients in 75 does not 
necessarily add complexity to the system as there 
may be a scale up function in the dequantizer 25. 
The scale down function 76 may also be incor- 
porated in the inverse transformer 11; but, in any 
event, appropriate scaling in these combinations 
will be within the purview of those of skill in the art. 

The first important feature to be noted in the 
inventive system, which has implications on im- 
plementation complexity, is that AC prediction is 
done only in the decoder portions. Thus, unlike the 
prior art, with the invention it is not necessary to 
transmit the prediction difference, but rather the 
original AC coefficients themselves are transmitted. 
Prediction is only used to improve the quality of 
the decoded image; it has no impact on the coding 
rate, It has been determined experimentally that 



with prior art techniques, such as that of NISS, AC 
prediction has a greater impact on image quality 
than on compression efficiency. The second impor- 
tant feature is that unlike the decoder shown in 

5 Figure 2, a finer quantization, q, is used for the 
prediction coefficients. In this manner it is possible 
to predict AC values which could not be detected 
by the coarse quantization Q. In problem areas, 
such as flat areas of the image, the AC coefficients 

70 tend to be small so that coarse quantization Q will 
miss them. Thirdly, in accordance with the inven- 
tion, after mapping the AC predictions through a 
thresholder operation, P, the predictions are added 
to a scaled version of the original quantized AC 

75 coefficients. It is preferred that q be a linear scaled 
down version of Q, e.g., q scale down = DC, AC 
scale up. 

With regard to scaling, attention is called to 
Fig. 7 which diagrams quantization scaling factors, 

20 wherein, for instance, a scaling factor of four is 
shown. It will be seen that Qi = q* and qi = Q/4. 
This same scaling factor would be applied to scale 
up the DC, AC components in Fig 5a. Another 
important aspect of the invention is the use of 

25 thresholder P. Without proper thresholding large 
errors could be introduced in the AC-prediction 
estimates. The thresholding function P of the inven- 
tion is used to insure that only AC predictions 
which could not be detected and quantized Q by 

30 the coarse quantizers are allowed, i.e., predicted 
values which can be detected by the coarse quan- 
tizers are simply set to zero. Thus, assuming that 
the quantizer decision levels are in between the 
reconstruction levels, and that anything above Qi/2 

35 would be detected by quantizer Q, the mapping 
generated by P forces qi = 0 for qi £ Qi/2. This 
mapping implicitly allows the generation of AC- 
prediction for smooth areas of the image only. The 
AC predictions for active areas - where predictions 

40 would normally be large - are forced to zero. The 
smooth areas are thus substantially improved in 
quality. Since the decoder can calculate the predic- 
tion from known information, the improvement in 
quality comes at -NO PENALTY to compression. 

45 Experiments show a far superior image quality is 
obtained when the image is reconstructed in this 
manner as compared to the use of no AC-predic- 
tion. 

Another decoder embodiment in accordance 
so with the invention is shown in Fig. 5b. wherein 
scale up of the DC and AC coefficient -inputs is 
performed at 75' prior to their being fed^ over 
respective lines 92 and 93 to AC predictor 32 . The 
output of predictor 32' is quantized Q in quantizer 
55 24 and thresholded in thresholder 80 before being 
: fed to summer 44. With this arrangement, the scale 
down function on the AC prediction quantizer 24 of 
Fig. 5a is not needed in quantizer 24 , however, 



BNSDOCIO: <EP 0422404A2> 



EP 0 422 404 A2 



10 



greater • arrthmetic precision and larger lookup ta- 

fmctio TinT'Tn J" imp ' ementin9 the predic «°n 
oy P forces q, = rj for q, > 2Q, . 

A further implementation of a decoder in accor- 
dance wt h the invention is shown in Fig. 5c t I 
embodiment, inverse quantization Q- £ perf^ 
by inverse quantizer 26 on the DC and AC cZft 
cent .nputs prior to their being fed over lines Z 
and 93 to an AC predictor 3 /_ mh ZtZ g l 
rnent, dequantizer 25 and quantizers 24 and 24 of 

but fhir r ! mb ° dimentS may 06 dispensed with; 
but, a higher precision dequantization Q- is need- 
ed, and lookup table implementation of the predic- 
ton unction would require large tables so that the 
° f '° 9iCai ^^^P'iesm^l 6 
While the invention has in the preceding em- 
, n c IT deSCribed 35 ap P lied •«> P^ess- 

osed tnT T • th6 inventive princi P' es dis- 
closed can also be applied to the progressive 

° f ™»™ '^Qes. -n confrj to 
the AC-predction performed by the predictor 30 on 
DC coefficients ,n the prior art still frame encoder 
of Fig. 1a a still frame encoder in accordance with 
the invention is shown in Fig. 6a. wherein it will be 
seen that not only the DC-coefficients, bu I 
portion Ac of ^ AC . coefficients AC ^ ^ 

prediction in a predictor 36. Aside from the differ- 

aTL^^ imPr ° Ved AC -P-dic«on 
and the addition of a thresholds 81, the other 
elements of the encoder shown in figure 6a e 

the same as those of the prior art encoder of Fig 

the Act ?: 63 embodiment - ^e portion AC' of 
he AC-coefficents AC constitute those portions of 
the concents that are "coarsely quantized". Fo 
oM,2,' ^ ^ Si ^ m ^tu6e representation 

1 s 1 T t,26d AC C06fficients ' AC-quantizer 
levels can be represented as between -127 and 
1^7 AC could correspond to the most siqnifi- 
cant bit (MSB) of an AC value, i.e., the first J after 
the sign- with the sign bit transmitted only if the 
value of AC is non-zero. In such case, aV can 
only assume the values of + 64, 0, or -64 and can 
be thought of as a requantization of AC with a 
near q U a n ti 2er ste p 64 times the original quantizer 
Sh th h e ,P referred embodiment of the invention, 
the hresholding P of thresholds 81 is controlled 

K IT A h c , J n ^ differ8nt wavs - Fir *'y. * 

AC *0. the thresholds forces the prediction to be 
zero (no predictions. 

Secondly, if AC' = 0 the thresholder will allow 
quantized predicted values less than 63; larqer 
values are set to zero. This threshold is chosen 

S ■ ,ar9 r AC va ! ue would ^ve been de- 
tected by the value of AC in the first place 



For AC =0 -in successive siao.es of 
progression- the difference between the original 

transmitted. Since no sign information was trans- 

soTalt A r ' *• S, ' 9n C3n be t-^-itte a S s 
soon as the first non-zero magnitude bit of the 
difference is sent. For AC*o, the remaining lea* 
s.gn,f,cant bits (LSB) are simply transmitted 

A progressive still frame decoder accordina to 

nd T ti ° n J S Sh ° Wn in R9 ' 6b " ^ « °C 

TuJL ^ fed t0 3n AC P redic *» 33, 

quantized ,n quantizer 28, and thresholded P in 

hres oider 82. before being summed with AAC 

signals ,n summer 46. The operation of this de- 

3 LTS 0 th : h procedure of the enC0der " 

Mg. 6a If AC * 0, the prediction is zero and AC' is 
-combined, through summers 47 and 46 Jh 
AAC wh,ch contains the least significant bits (LSB) 

20 i ° o n ;' f t = °' PredCti0n is 

20 before it gets added to the difference data transmit- 
ted in later stages of the progression 

It might be noted that in the event that the 
quantization is not linear in the cited embodiments 

a5 ou o? ! f menta !!° n of the invention can b * «25 

* out by defining the threshold values differently 

Fias 8 W zl 0i a e T P>e ' f, ° WCharts are shown <" 
Nils-, \r i ° f SOftWare "nPtementattons of 
NISSs AC prediction formulas in combination with 

so !n! S I' accordance with the present inven- 

alues of 1 0 Sh T r a " 0WS qUanti2ed pr9dicted 
values of -1, 0, and +1 only. Further, the predictor 

fine quantizer is of the form of that in Fig 7 

are tS/ff'S/ * 8 " five AC coefficients 

35 a d thr?: C ° h MPUTE - TH R calculates THR1 

TL ♦ 1 T C ° efficient - For each coefficient 

the ( C . 9radi6nt iS CalCulated wording to 

the formulas taken from NISS and MITCHELL ET 

QRAD(0,1) = (DC, -DC 6 ) 
40 GRAD(1,0) = (DC 2 -DC 8 ) 

QRAD(2,0) = (DC 2 + DCs- 2 x DC S ) 
GRAD0.1, = (DC, + DC 9 - DC 3 - DC 7 ) 
QRAD(0,2) = (DC, + DC s -2xDC 5 ) 
4s nn at ! aCh . 9 ? u i6nt iS com P are d against the appro- 
o 2 Lf threSh0 ' dS - ' f the abso,ute ^ of the 
THR l' S 9reat6r ° r eQUal t0 THR2 or ^ss than 

(ir< THR^'h i 2era " THRl(iJ) * GRAD - 

[i,D < rHR2(i,j) the prediction is 1 

so is 'rStH t T h AD(ij) * ■ THR2(i ' j) the P red *n 
L • th3t the ° rder 0f the ^estions is impor- 
tant since ,t is possible that THR1 and THR2 ai 
equal. Also note that the gradients are obtained by" 
using quantized DC levels. Finally note that the 
resulting predictions are stored in the same OCT 
ss array where AC_DECODE adds its decoded vaN 

in, C f Ti TE - THR: R9 - 9 i,,ustrate * the comput- 
ing of the thresholds used in AC prediction. A set 



of two thresholds are computed for each AC coeffi- 
cient predicted. These thresholds incorporate the 
dequantization of the DC gradient, Q 0t o9; and the 
reduction of the AC quantizer step, Qi/4 (see Fig. 
7), The constants K(i,j) are derived from NISS after 
a scale up of a factor of 2 12 , so as to permit integer 
arithmetic. For example, K(0,1) = 9.1 108x4096. 
These formulas require further normalization by 2 s 
= 64 so that the total normalization becomes 2 s 2 12 
=: 2 18 . The integer values of K are: 
K(0,1) = 37318 
K(1,D) = 37318 
K(2,0) = 9136 
K(1,1) = 5313 
K(0,2) = 9136 

DELTA represents the unnormalized contribu- 
tion of a step of one in the DC gradient to the 
quantized AC coefficient THR1 counts the number 
of DC gradients steps needed to generate a quan- 
tized AC prediction of value 1. THR2 counts the 
number needed to generate a quantized AC predic- 
tion of value 2. The initial value of TEM = 2 17 is 
used for rounding. 

It will accordingly be seen that a system and 
method are disclosed for improving image quality 
in intraframe transform based coding techniques by 
using prediction of the AC components, which pre- 
diction takes place only in the decoder portions of 
the system and is combined with a thresholding 
function. 



Claims 

1. In a data compression system wherein input 
images are subdivided into blocks of pixels and 
said blocks of pixels are changed into blocks of 
coefficients by a forward transform coding opera- 
tion, said transform coefficients including DC coeffi- 
cients, representative of the average value in a 
block of 'pixels, and AC coefficients, representative 
of harmonic frequencies in a block of pixels, a 
method for recovering a representation of an input 
image from the transform coefficients comprising 
the steps of: 

a) receiving said transform coefficients for ail of 
said blocks of said image; 

b) generating predicted values for selected 
transform coefficients in a given block from the 
values of received transform coefficients, 
wherein said selected coefficients comprise AC 
coefficients; 

c) thresholding said predicted coefficient values 
of said block; 

d) *adding received transform coefficient values 
for said given block to corresponding to said 
thresholded coefficient values from step c); 

e) repeating each of steps b) through d) for all 



of the blocks of said image received; and 

f) recovering said image representation by ap- 
plying an inverse transform operation to the 
results of the additions of step d) for all of said 

s blocks of said image received. 

2. The method of claim 1 wherein said received 
transform coefficients for all of said blocks have 
been quantized and comprising the further steps 
of: 

w g) quantizing said predicted coefficient values 
before said thresholding; and 
h) dequantizing the results of the additions of 
• step d) before applying said inverse transform 
operation. 

75 3, The method of claim 2 wherein said quantizing 
of said predicted coefficient values before said 
thresholding is a finer quantization than that of said 
received transform coefficients for all of said 
blocks. 

20 4. The method of claim 1 further comprising the 
steps of: 

g) scaling said received coefficient values of 
said blocks to match the precision of the 
thresholded coefficient values in step c) before 

25 the additions in step d); and 

h) compensating for the scaling of step g) after 
applying said inverse transform operation. 

5. The method of claim 4 wherein said scaling step 
g) comprises scaling up said received coeffi- 

30 cient values of said blocks before the generating 
. of predicted values for selected transform coeffi- 
cients from the values of said received trans- 
form coefficients. 

6. The method of claim 1 wherein said received 
35 transform coefficients for all of said blocks have 

been quantized and comprising the further step of 
dequantizing said received coefficient values of 
said blocks before the generating of predicted val- 
ues for selected transform coefficients from the 
40 values of said received transform coefficients. 

7. The method of one of claims 1 to 6 incorporated 
in the decoder feedback loop of a transform based 
motion video encoder. 

8. In a data compression system wherein input 
45 images are subdivided into blocks of pixels and 

said blocks of pixels are changed into blocks of 
coefficients by a forward transform coding opera- 
tion, said transform coefficients including DC coeffi- 
cients, representative of the average value in a 
50 block of pixels, and AC coefficients, representative 
of harmonic frequencies in a block of pixels, an 
apparatus for recovering a representation of an 
input image from the transform coefficients .com- 
prising: 

55 a) first means for receiving said transform coeffi- 
cients for all of said blocks of said image; 
b)- second means, connected to said first means 
and responsive to said received transform co- 
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efficients, for generating predicted values for 
selected transform coefficients in a given block 
from the values of said received transform co- 
eff.c.ents, wherein said selected coefficients 
comprise AC coefficients; 

c) third means, connected to said second 5 
means, for thresholding said predicted coeffi- 
cient values of said block generated by said 
second means; 

d) fourth means, connected to said first and m 
third means, for adding corresponding received 
transform coefficient values from said first 
means and thresholded coefficient values from 

said third means; 

e) fifth means for repeatedly reactivating said rs 
second, third, and fourth means to operate on 

said transform coefficients of all of the blocks of 
said image received; and 

f) sixth means, connected to said fourth means 

for applying an inverse transform operation to 20 
the results of the additions performed by said 
fourth means on all of said blocks of said image 
received, to recover said image representation. 

9. The apparatus of claim 8 wherein said received 
transform coefficients for all of said blocks have 25 
been quantized and further comprising: 

9) seventh means, connected to said second 
means, for quantizing said predicted coefficient 
values before said thresholding; and 
h) eighth means, connected to said fourth 30 
means, for dequantizing the results of the addi- 
tions before said sixth means applies said in- 
verse transform operation. 

10. The apparatus of claim 8 further comprising: 

Q) seventh means, connected to said first means 35 
and said fourth means, for scaling said received 
coefficient values of said blocks to match the 
precision of the thresholded coefficient values 
from said third means before the additions by 
said fourth means; and 4Q 
h) eighth means, connected to said sixth means 
for compensating for the scaling of said seventh 
means after the application of said inverse trans- 
form operation. 

1 1 . The apparatus of claim 8 wherein said received as 
transform coefficients for all of said blocks have 
been quantized and further comprising seventh 
means, connected to said first means for dequan- 
tizing said received coefficient values of said 
blocks before said second means generates the 50 
predicted values for selected transform coefficients 
from the values of said received transform coeffi- 
cients. 

12. The apparatus of one of claims 8 to 11 further 
comprising a transform based motion video en- ss 
coder having a feedback loop and wherein said first 
through sixth means are incorporated in said en- 
coder in said feedback loop. 



13. In a progressive transmission scheme for still 
frame images wherein input images are subdivided 
into blocks of pixels, said blocks of pixels are 
changed into blocks of coefficients by transform 
coding techniques, and said coefficients are quan- 
tized and transmitted progressively, and said trans- 
mission comprises a first stage wherein the most 
significant bits of said coefficients in all blocks are 
sent followed by successive stages wherein less 
significant bits of said coefficients are sent, a meth- 
od for recovering a representation of an input im- 
age from the coded transmission comprising the 
steps of: 

a) receiving the first stage quantized coefficient 
bit values for all of said blocks of said image- 

b) generating a quantized predicted value' for 
certain coefficients in a given block; 

c) thresholding said predicted coefficient bit val- 
ues of said block; 

d) adding the thresholded coefficient bit values 
from step c) to the corresponding quantized 
coefficient bit values of said block; 

e) repeating each of the foregoing steps for all 
of the blocks of said image received; 

and 

f) recovering said image representation by ap- 
plying an inverse transform operation to the 
results of the additions of step d) for all of said 
blocks of said image received. 

14. The method of claim 13 further compromising 
the steps of a 

g) additionally receiving said less significant bit 
values from said successive stages for all of 
said blocks of said image; and 

h) including said less significant bit values from 
said successive stages for all of said blocks of 
said image in said addition step d). 
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